Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Managing patient deterioration : a protocol for enhancing undergraduate nursing students’ competence through web-based simulation and feedback techniques

Aims: To describe a funded proposal for the development of an on-line evidence based educational program for the management of deteriorating patients.
Background: There are international concerns regarding the management of deteriorating patients with issues around the ‘failure to rescue’. The primary response to these issues has been the development of medical emergency teams with little focus on the education of primary first responders.
Design/Methods: A mixed methods triangulated convergent design. In this four phase proposal we plan to 1. examine nursing student team ability to manage deteriorating patients and based upon these findings 2. develop web based educational material, including interactive scenarios. This educational material will be tested and refined in the third Phase 3, prior to evaluation and dissemination in the final phase.
Conclusion: This project aims to enhance knowledge development for the management of deteriorating patients through rigorous assessment of team performance and to produce a contemporary evidence-based online training program.

Undergraduate nursing students' performance in recognising and responding to sudden patient deterioration in high psychological fidelity simulated environments: an Australian multi-centre study

Objectives
This paper reports the quantitative findings of the first phase of a larger program of ongoing research: Feedback Incorporating Review and Simulation Techniques to Act on Clinical Trends (FIRST2ACTTM). It specifically aims to identify the characteristics that may predict primary outcome measures of clinical performance, teamwork and situation awareness in the management of deteriorating patients.

Design
Mixed-method multi-centre study.

Setting
High fidelity simulated acute clinical environment in three Australian universities.

Participants
A convenience sample of 97 final year nursing students enrolled in an undergraduate Bachelor of Nursing or combined Bachelor of Nursing degree were included in the study.

Method
In groups of three, participants proceeded through three phases: (i) pre-briefing and completion of a multi-choice question test, (ii) three video-recorded simulated clinical scenarios where actors substituted real patients with deteriorating conditions, and (iii) post-scenario debriefing. Clinical performance, teamwork and situation awareness were evaluated, using a validated standard checklist (OSCE), Team Emergency Assessment Measure (TEAM) score sheet and Situation Awareness Global Assessment Technique (SAGAT). A Modified Angoff technique was used to establish cut points for clinical performance.

Results
Student teams engaged in 97 simulation experiences across the three scenarios and achieved a level of clinical performance consistent with the experts' identified pass level point in only 9 (1%) of the simulation experiences. Knowledge was significantly associated with overall teamwork (p = .034), overall situation awareness (p = .05) and clinical performance in two of the three scenarios (p = .032 cardiac and p = .006 shock). Situation awareness scores of scenario team leaders were low overall, with an average total score of 41%.

Conclusions
Final year undergraduate nursing students may have difficulty recognising and responding appropriately to patient deterioration. Improving pre-requisite knowledge, rehearsal of first response and team management strategies need to be a key component of undergraduate nursing students' education and ought to specifically address clinical performance, teamwork and situation awareness.

Situation awareness in undergraduate nursing students managing simulated patient deterioration

Nursing work often occurs in complex and potentially hazardous settings. Awareness of patient and practice environments is an imperative for nurses in practice.

Patient deterioration education: Evaluation of face-to-face simulation and e-simulation approaches

Background: Simulation-based education is one strategy that may be used to teach nursing students to recognize and manage patient deterioration. Method: Final-year preregistration nursing students (n=97) completed three face-to-face laboratory-based team simulations with a simulated patient (actor) and 330 students individually completed a three-scenario Web-based simulation program: FIRST2ACTWeb™. Results: Both groups achieved moderate performance scores (means: face to face, 49%; e-simulation, 69%). Course evaluations were positive, skill gain showing a greater effect size in the face-to-face program than for e-simulation, and higher satisfaction and more positive appraisal. Conclusion: Face-to-face simulation and e-simulation are effective educational strategies with e-simulation offering greater feasibility. Either strategy is likely to add value to the learning experience.

Doing the right thing at the right time: Assessing responses to patient deterioration in electronic simulation scenarios using course-of-action analysis

International studies indicate that the recognition and management of deteriorating patients in hospitals are poor and that patient assessment is often inadequate. Face-to-face simulation programs have been shown to have an impact on educational and clinical outcomes; however, little is known about performance in contemporary healthcare e-simulation approaches. Using data from an open-access Web-based patient deterioration program (FIRSTACTWeb), the performance of 367 Australian nursing students in identification of treatment priorities and clinical actions was analyzed using a military model of Course of Action Simulation Analysis. Participants' performance in the whole program demonstrated a significant improvement in knowledge and skills (P ≤ .001) with high levels of participant satisfaction. Course of Action Simulation Analysis modeling identified three key participant groupings within which only 18% took the "best course of action" (the right actions and timing), with most (70%) completing the right actions but in the wrong order. The remaining 12% produced incomplete assessments and actions in an incorrect sequence. Contemporary approaches such as e-simulation do enhance educational outcomes. Measurement of performance when combined with Course of Action Simulation Analysis becomes a useful tool in the description of outcomes, an understanding of decision making, and the prediction of future events.

Corrigendum to "Undergraduate nursing students' performance in recognising and responding to sudden patient deterioration in high psychological fidelity simulated environments: An Australian multi-centre study" [Nurse Educ. Today 34(5) (May 2014

The authors regret that the original text: The SAGAT instrument has been previously validated (Bell et al., 2006) is incorrect and should read: The SAGAT technique has been demonstrated as valid, sensitive and reliable measure of situation awareness in diverse applications (Endsley, 2000).

Endsley, M. R. (2000) Direct measurement of situation awareness: Validity and use of SAGAT. In Endsley, M.R. & Garland, D.J. (Eds.), Situation awareness analysis and measurement (pp 147–173). New Jersey: Lawrence Erlbaum Associates.

The authors would like to apologise for any inconvenience caused.

An analysis of nursing students' decision-making in teams during simulations of acute patient deterioration

AIM: The aim of this study was to examine the decision-making of nursing students during team based simulations on patient deterioration to determine the sources of information, the types of decisions made and the influences underpinning their decisions.

BACKGROUND: Missed, misinterpreted or mismanaged physiological signs of deterioration in hospitalized patients lead to costly serious adverse events. Not surprisingly, an increased focus on clinical education and graduate nurse work readiness has resulted.

DESIGN: A descriptive exploratory design.

METHODS: Clinical simulation laboratories in three Australian universities were used to run team based simulations with a patient actor. A convenience sample of 97 final-year nursing students completed simulations, with three students forming a team. Four teams from each university were randomly selected for detailed analysis. Cued recall during video review of team based simulation exercises to elicit descriptions of individual and team based decision-making and reflections on performance were audio-recorded post simulation (2012) and transcribed.

RESULTS: Students recalled 11 types of decisions, including: information seeking; patient assessment; diagnostic; intervention/treatment; evaluation; escalation; prediction; planning; collaboration; communication and reflective. Patient distress, uncertainty and a lack of knowledge were frequently recalled influences on decisions.

CONCLUSIONS: Incomplete information, premature diagnosis and a failure to consider alternatives when caring for patients is likely to lead to poor quality decisions. All health professionals have a responsibility in recognizing and responding to clinical deterioration within their scope of practice. A typology of nursing students' decision-making in teams, in this context, highlights the importance of individual knowledge, leadership and communication.

A trial of e-simulation of sudden patient deterioration (FIRST2ACT WEB) on student learning

BACKGROUND: High-fidelity simulation pedagogy is of increasing importance in health professional education; however, face-to-face simulation programs are resource intensive and impractical to implement across large numbers of students. OBJECTIVES: To investigate undergraduate nursing students' theoretical and applied learning in response to the e-simulation program-FIRST2ACT WEBTM, and explore predictors of virtual clinical performance. DESIGN AND SETTING: Multi-center trial of FIRST2ACT WEBTM accessible to students in five Australian universities and colleges, across 8 campuses. PARTICIPANTS: A population of 489 final-year nursing students in programs of study leading to license to practice. METHODS: Participants proceeded through three phases: (i) pre-simulation-briefing and assessment of clinical knowledge and experience; (ii) e-simulation-three interactive e-simulation clinical scenarios which included video recordings of patients with deteriorating conditions, interactive clinical tasks, pop up responses to tasks, and timed performance; and (iii) post-simulation feedback and evaluation. Descriptive statistics were followed by bivariate analysis to detect any associations, which were further tested using standard regression analysis. RESULTS: Of 409 students who commenced the program (83% response rate), 367 undergraduate nursing students completed the web-based program in its entirety, yielding a completion rate of 89.7%; 38.1% of students achieved passing clinical performance across three scenarios, and the proportion achieving passing clinical knowledge increased from 78.15% pre-simulation to 91.6% post-simulation. Knowledge was the main independent predictor of clinical performance in responding to a virtual deteriorating patient R(2)=0.090, F(7, 352)=4.962, p<0.001. DISCUSSION: The use of web-based technology allows simulation activities to be accessible to a large number of participants and completion rates indicate that 'Net Generation' nursing students were highly engaged with this mode of learning. CONCLUSION: The web-based e-simulation program FIRST2ACTTM effectively enhanced knowledge, virtual clinical performance, and self-assessed knowledge, skills, confidence, and competence in final-year nursing students.

Recognising paediatric deterioration in a simulated environment

This thesis examined the impact of high fidelity patient simulation on paediatric critical care nurses' self-efficacy and knowledge for recognising and responding to paediatric deterioration. This research highlights the positive effect simulation education can have on nursing learning outcomes which may influence patient safety through the timely recognition and management of the deteriorating child.

Leadership and teamwork in medical emergencies: performance of nursing students and registered nurses in simulated patient scenarios

Aims and objectives: To examine nursing students' and registered nurses' teamwork skills whilst managing simulated deteriorating patients. Background: Studies continue to show the lack of timely recognition of patient deterioration. Management of deteriorating patients can be influenced by education and experience. Design: Mixed methods study conducted in two universities and a rural hospital in Victoria, and one university in Queensland, Australia. Methods: Three simulation scenarios (chest pain, hypovolaemic shock and respiratory distress) were completed in teams of three by 97 nursing students and 44 registered nurses, equating to a total of 32 student and 15 registered nurse teams. Data were obtained from (1) Objective Structured Clinical Examination rating to assess performance; (2) Team Emergency Assessment Measure scores to assess teamwork; (3) simulation video footage; (4) reflective interview during participants' review of video footage. Qualitative thematic analysis of video and interview data was undertaken. Results: Objective structured clinical examination performance was similar across registered nurses and students (mean 54% and 49%); however, Team Emergency Assessment Measure scores differed significantly between the two groups (57% vs 38%, t = 6·841, p < 0·01). In both groups, there was a correlation between technical (Objective Structured Clinical Examination) and nontechnical (Team Emergency Assessment Measure) scores for the respiratory distress scenario (student teams: r = 0·530, p = 0·004, registered nurse teams r = 0·903, p < 0·01) and hypovolaemia scenario (student teams: r = 0·534, p = 0·02, registered nurse teams: r = 0·535, p = 0·049). Themes generated from the analysis of the combined quantitative and qualitative data were as follows: (1) leadership and followership behaviours; (2) help-seeking behaviours; (3) reliance on previous experience; (4) fixation on a single detail; and (5) team support. Conclusions: There is scope to improve leadership, team work and task management skills for registered nurses and nursing students. Simulation appears to be beneficial in enabling less experienced staff to assess their teamwork skills. Relevance to clinical practice: There is a need to encourage less experienced staff to become leaders and for all staff to develop improved teamwork skills for medical emergencies. © 2014 John Wiley & Sons Ltd.

Leadership and teamwork in medical emergencies: Performance of nursing students and registered nurses in simulated patient scenarios

Aims and objectives: To examine nursing students' and registered nurses' teamwork skills whilst managing simulated deteriorating patients. Background: Studies continue to show the lack of timely recognition of patient deterioration. Management of deteriorating patients can be influenced by education and experience. Design: Mixed methods study conducted in two universities and a rural hospital in Victoria, and one university in Queensland, Australia. Methods: Three simulation scenarios (chest pain, hypovolaemic shock and respiratory distress) were completed in teams of three by 97 nursing students and 44 registered nurses, equating to a total of 32 student and 15 registered nurse teams. Data were obtained from (1) Objective Structured Clinical Examination rating to assess performance; (2) Team Emergency Assessment Measure scores to assess teamwork; (3) simulation video footage; (4) reflective interview during participants' review of video footage. Qualitative thematic analysis of video and interview data was undertaken. Results: Objective structured clinical examination performance was similar across registered nurses and students (mean 54% and 49%); however, Team Emergency Assessment Measure scores differed significantly between the two groups (57% vs 38%, t = 6·841, p < 0·01). In both groups, there was a correlation between technical (Objective Structured Clinical Examination) and nontechnical (Team Emergency Assessment Measure) scores for the respiratory distress scenario (student teams: r = 0·530, p = 0·004, registered nurse teams r = 0·903, p < 0·01) and hypovolaemia scenario (student teams: r = 0·534, p = 0·02, registered nurse teams: r = 0·535, p = 0·049). Themes generated from the analysis of the combined quantitative and qualitative data were as follows: (1) leadership and followership behaviours; (2) help-seeking behaviours; (3) reliance on previous experience; (4) fixation on a single detail; and (5) team support. Conclusions: There is scope to improve leadership, team work and task management skills for registered nurses and nursing students. Simulation appears to be beneficial in enabling less experienced staff to assess their teamwork skills. Relevance to clinical practice: There is a need to encourage less experienced staff to become leaders and for all staff to develop improved teamwork skills for medical emergencies.

Managing women with acute physiological deterioration: student midwives performance in a simulated setting

OBJECTIVE: Midwives' ability to manage maternal deterioration and 'failure to rescue' are of concern with questions over knowledge, clinical skills and the implications for maternal morbidity and, mortality rates. In a simulated setting our objective was to assess student midwives' ability to assess, and manage maternal deterioration using measures of knowledge, situation awareness and skill, performance. METHODS: An exploratory quantitative analysis of student performance based upon performance, ratings derived from knowledge tests and observational ratings. During 2010 thirty-five student, midwives attended a simulation laboratory completing a knowledge questionnaire and two video, recorded simulated scenarios. Patient actresses wearing a 'birthing suit' simulated deteriorating, women with post-partum and ante-partum haemorrhage (PPH and APH). Situation awareness was, measured at the end of each scenario. Applicable descriptive and inferential statistical tests were, applied to the data. FINDINGS: The mean total knowledge score was 75% (range 46-91%) with low skill performance, means for both scenarios 54% (range 39-70%). There was no difference in performance between the scenarios, however performance of key observations decreased as the women deteriorated; with significant reductions in key vital signs such as blood pressure and blood loss measurements. Situation, awareness scores were also low (54%) with awareness decreasing significantly (t(32)=2.247, p=0.032), in the second and more difficult APH scenario. CONCLUSION: Whilst knowledge levels were generally good, skills were generally poor and decreased as the women deteriorated. Such failures to apply knowledge in emergency stressful situations may be resolved by repetitive high stakes and high fidelity simulation.

Early warnings of heart rate deterioration

Hospitals can experience difficulty in detecting and responding to early signs of patient deterioration leading to late intensive care referrals, excess mortality and morbidity, and increased hospital costs. Our study aims to explore potential indicators of physiological deterioration by the analysis of vital-signs. The dataset used comprises heart rate (HR) measurements from MIMIC II waveform database, taken from six patients admitted to the Intensive Care Unit (ICU) and diagnosed with severe sepsis. Different indicators were considered: 1) generic early warning indicators used in ecosystems analysis (autocorrelation at-1-lag (ACF1), standard deviation (SD), skewness, kurtosis and heteroskedasticity) and 2) entropy analysis (kernel entropy and multi scale entropy). Our preliminary findings suggest that when a critical transition is approaching, the equilibrium state changes what is visible in the ACF1 and SD values, but also by the analysis of the entropy. Entropy allows to characterize the complexity of the time series during the hospital stay and can be used as an indicator of regime shifts in a patient’s condition. One of the main problems is its dependency of the scale used. Our results demonstrate that different entropy scales should be used depending of the level of entropy verified.